Accelerated growth in outgoing links in evolving networks: deterministic vs. 

stochastic picture 
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In several real- world networks like the Internet, WWW etc., the number of links grow in time in 
a non-linear fashion. We consider growing networks in which the number of outgoing links is a non- 
linear function of time but new links between older nodes are forbidden. The attachments are made 
using a preferential attachment scheme. In the deterministic picture, the number of outgoing links 
m{t) at any time t is taken as N{tY where N(t) is the number of nodes present at that time. The 

continuum theory predicts a power law decay of the degree distribution: P(k) oc k i-f , while the 
degree of the node introduced at time ti is given by k{ti,t) = t1[j-]^~ when the network is evolved 
till time t. Numerical results show a growth in the degree distribution for small k values at any 
non-zero 0. In the stochastic picture, m{t) is a random variable. As long as {m{t)) is independent of 
time, the network shows a behaviour similar to the Barabasi-Albert (BA) model. Different results 
are obtained when {m{t)) is time-dependent, e.g., when m{t) follows a distribution P{m) oc m~^. 
The behaviour of P{k) changes significantly as A is varied: for A > 3, the network has a scale-free 
distribution belonging to the BA class as predicted by the mean field theory, for smaller values of 
A it shows different behaviour. Characteristic features of the clustering coefficients in both models 
have also been discussed. 

PACS numbers: 05.70.Jk, 64.60.Fr, 74.40. Cx 



I INTRODUCTION 

In many real-world networks which evolve in time, the 
number of links show a nonlinear growth in time . Ex- 
amples of such network are the Internet , World Wide 
Web (WWW) 0, collaboration 0, word web 0, cita- 
tion ^i2|J , metabohsm , gene regulatory network 0,0] 
etc. The number of links may increase in a two-fold way: 
new nodes may tend to get attached to more nodes as the 
size of the network increases, and secondly there may be 
additional links generated between the older nodes in a 
non-linear fashion as shown in Fig. 1. These two factors 
maybe present either singly or simultaneously resulting 
in the accelerated growth. In some networks like the 
citation and the gene regulatory network, new links be- 
tween older nodes are forbidden and therefore only the 
first scheme is valid, while in collaboration network or 
internet, the second factor is dominating. 

The case when the new node gets a fixed number of 
links but older nodes get new links in a non-linear fash- 
ion has been considered in both isotropic and directed 
models of growing networks |3, S ^3 1 showing that it is 
distinct from networks with a linear growth rule. Here, 
the number of links generated between the older nodes 
is considered to have a power law growth in time. This 
choice is made because the assumption that scale-free 
behaviour (which is a desirable feature of networks) is 
present in a network with accelerated growth has been 
argued to be consistent with a power-law growth of links 
The evolution of the networks in these models of 
accelerated growth was made using a preferential attach- 
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FIG. 1: The way accelerated growth takes place: in scheme 
(a), followed in this paper, the new node gets an increased 
number of links as time progresses, no new link between old 
nodes are allowed. In scheme (b), the new node gets a single 
link and old nodes get new links (shown by dashed lines) with 
the total number of links following a nonlinear growth in time. 
The most general case is a combination of the two schemes. 



ment scheme as in the Barabasi-Albert network (BA) 
|l2j | . In the directed network, this rule is modified by al- 
lowing an additional parameter, the initial attractiveness, 
in the attachment rule There is also an alternative 
way of achieving a scale-free network proposed by Huber- 
man and Adamic |l4l| which has been used for modelling 
the internet network with accelerated growth [isj. 



The preferential attachment scheme in the original BA 
network is the simple rule that the incoming nodes get 
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attached to the zth node according to the probabiHty 



n,; 



(1) 



where ki is the degree (number of coonections) of the ith 
node. This leads to the result that the number of links k 
is distributed according to 



P{k) oc fc-^ 



(2) 



for large k. Let the ith node be introduced at time U. 
Usually one node at a time is introduced such that i = U. 
The degree of the ith node at a later time t is then de- 
noted by t), which in the BA model can be estimated 



k{ti, t) — const [—] 



(3) 



In general, the exponent P describes the variation of 
k{ti,t) with t~^, however in the case of the BA model, 
the behaviour with t is also given by the same expo- 
nent. The values of the exponents can be obtained in 
the BA model exactly: 7 = 3 and /3 = 1/2, satisfying 
the relation /3(7 — 1) = 1. This relation holds good in 
a more generalised version of the BA model as well . 
In the BA network, the incoming node gets a fixed num- 
ber of links Too and the characteristics of the network 
do not depend on the specific value of toq. No new link 
between older nodes is allowed. The models of acceler- 
ated growth considered so far assume that older nodes 
get new links (scheme (b) in Fig. 1), which is a sufficient 
departure from the original Barabasi- Albert model. We 
consider the simpler case where the number of outgoing 
links m{t) is no longer a constant but a function of time 
and no new link between older nodes is allowed (scheme 
(a) of Fig. 1). This is also a realistic scheme as one can 
expect the number of attachments of a new node to in- 
crease when it is exposed to a larger environment. We 
have considered both deterministic and stochastic rules 
governing the form of m(t). 

The focus of the present paper is on the behaviour 
of the various degree distributions in the networks with 
accelerated growth. A brief discussion of the clustering 
properties of the networks have also been made. The 
clustering coefficient Ci measures the number of links be- 
tween the neighbours of the ith node. Here we have esti- 
mated the average clustering coefficient C{t) in a network 
evolved upto time t (equal to the number of nodes) and 
also the the average clustering coefficient C{k) of nodes 
with degree k. These quantities have been shown to have 
interesting properties in networks [l^ . 

In section II, the deterministic picture is discussed 
where the number of outgoing links increases in time in a 
deterministic manner and in section III, stochastic mod- 
els are considered in which the number of outgoing links 
is a random variable. In the last section, the results are 
summarised and discussed. 



II DETERMINISTIC MODEL 

Let the number of nodes in a growing network be N{t) 
at time t. In the deterministic model, we take the num- 
ber of outgoing links available to an incoming node to 
be m{t) = N{ty. In a network which is grown by in- 
troducing one node at a time, N{t) — t, and therefore 
m{t) = , ensuring an accelerated growth in the number 
of links in the network. The links are made according to 
equation (1) as usual. 

One can obtain an expression for fc(ti,t) and P{k) us- 
ing a continuum theory following Here the rate of 
change of k{t.i,t) is taken proportional to kifSki. Go- 
ing to the continuum limit the total number of links is 
J t^d9 — t^+^/(l -I- 9) at time t, and the equation govern- 
ing k{t.i, t) takes the form 



dk{U,t) {e + l)k{U,t) 



dt 



2t 



leading to 



fc(i„i)=if[f](i+«)/^. 



(4) 



(5) 



In the last equation the boundary condition k{ti,t = 
ti) — tf has been inserted. From the above equation, 
we find that = (1 — 6')/2. That k{ti,t) is not a func- 
tion of t/ti alone is a result significantly different from 
the BA network. The degree distribution at time t shows 
the following behaviour: 



(6) 



1 i+p 

where f{t) — j^t^'^ • The value of 7 is therefore given 
by 



7 = 1 



1 



(7) 



In this model, there are two known limits: 9 = corre- 
sponds to the BA model and 9 = 1 corresponds to a fully 
connected network (i.e., an iV-clique). For the BA model, 
the degree distribution is a power-law distribution while 
for the fully connected network, P{k) is a delta function. 
This implies the possibility of the existence of a 'critical' 
9c where a peak occurs in the degree distribution for the 
first time. We conduct numerical simulations to explore 
this possibility. 



In the simulation, nodes are added one by one. A spe- 
cific number of links are assigned to each incoming node 
{m{t) = t^: the nearest integer is chosen) and links are 
made by the preferential attachment scheme. For larger 
values of 9 the network becomes highly connected and 
it takes a lot of time to generate it. Hence we restrict 
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FIG. 2: The normalised degree distribution in the determin- 
istic network for 6 = 0.1,0.3 and 0.5 are shown along- with 
straight lines in the log-log plot which have slopes according 
to equation (6). For 61 = 0.1 and 0.3, t = 4000 and for 9 = 0.5, 
t = 2000. 



to values oi 9 < 0.7 and to times t < 4000; the latter 
is also the size of the network. The results show com- 
plete agreement with the analytical results as far as the 
decay of the degree distribution for large k is concerned 
(Fig. 2). A growth of the distribution for small k val- 
ues is noted as well. This growth seems to be faster 
than exponential as 9 is made larger. This fast growth 
suggests that the form of P{k) maybe assumed to be 
P{k) ~ k^^Q{k — kc) where kc is the value at which 
P{k) is maximum. The normalisation of P{k) can then 
be done by making P{k)dk = 1. Substituting P{k) 
from equation (6) and following the above normalisation 
procedure, we get an estimate of kc as a function of t, 
which is precisely fee = for large t. The numerical re- 
sults for discrete systems also agree with the above scal- 
ing, the agreement becoming better for larger values of 



FIG. 3; The in-degree, out-degree and total degree distribu- 
tions for 6 = 0.4 are shown. Pout{kout) is fitted with the 
calculated slope given by eq. 8. 
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FIG. 4: The scaling plot for k(ti,t) is shown for 9 = 0.4. Here 
k{ti,t) has been scaled by t"'^ as k{ti,t) varies as 
according to equation (5). The straight-line is drawn with 
slope 0.3 as /3 = (1 - 9)/2 = 0.3 here. 



Interestingly, we find that a peak is present in the de- 
gree distribution even for values of 9 < 1 which indicates 
the existence of 9c. Analysing the numerical results for 
small values of 9, we find that the peak in the distribution 
occurs as soon as 9 is made non-zero. This is established 
by the fact that as the network size is made larger (i.e., 
the time to which the network is evolved is made larger) 
the peak becomes sharper and P{k) decreases for small 
k values. Hence we conclude that 9c = 0. 



Although in this network P{k) has been calculated 
from the total degree of the nodes, we notice an inter- 
esting behaviour of the distributions of the in-degree kin 



and out-degree kout taken separately. It maybe men- 
tioned here that these distributions have also been ob- 
tained for real networks and in many of them it is seen 
that these are also scale-free with distinct exponents . 
The number of outgoing links in the present network is 
deterministic and has the following feature: the first ni 
nodes have out-degree 1, the next n2 have out-degree 2 
and so on (this is due to the discrete nature of the net- 
work). For 9 = 0, all nodes have out-degree 1 and its 
distribution Pout{kout) is a delta function (ni equals the 
number of nodes in the system and all ti^ = for i 7^ 1). 
For = 1, Til = 1, 712 = 1, 713 = 1 etc., and the out-degree 
distribution is a flat one. For intermediate values of 9, 
the exact form of Pout{kout) can be easily found out. Let 
t be the first time when the out-degree of the incoming 
node is kout and t + At the time at which the out-degree 
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increases to kout + 1- Clearly At = Pout{kout) and since 
kout =t^,we have et^~^At = l. Therefore 

Pout{kout) K ^^oMt ■ (8) 

Hence we find that the out-degree distribution actually 
grows with the degree, a result which is also verified in the 
numerical simulations (Fig. 3). Since for 9 < I, the out- 
degree never assumes a very large value in a network of 
finite size, we also note that for large k, the contribution 
to P{k) is mainly from kin- Consequently, we expect 
that Finikin) will have a power-law tail with 7 given by 
equation (7). This is also confirmed numerically. The 
growing region of the total degree distribution for small 
k is accounted for by the growing out-degree distribution 
as in this region both ki„ and fcout contribute. 

The behaviour of k(ti,t) is also in complete agree- 
ment with the theoretical results: plotting the scaled 
k{ti,t)/t^^^^'>^^ against ti for different values oft, a data 
collapse is obtained. This is shown in Fig. 4 for 9 — 0.4. 
The agreement with the continuum results becomes bet- 
ter as ti increases. 

All clustering coeffcients at 6* = are zero as no loops 
are allowed in this case. As 9 is increased, C{t) (with fixed 
t) shows an increase as expected. The increase is not 
very sharp at small values of 9, e.g., for 9 as high as 0.5, 
C{t) = 0.038 for t = 2000. Since C{t) = 1 for 6* = 1, it is 
expected that C{t) will show a sharper increase for larger 
values oi 9; it is however difficult to simulate networks in 
this range of values of 9 to check this behaviour. C{t) as a 
function of t shows a behaviour similar to the BA model; 
it decreases with t (at least upto 9 — 0.4; we have not 
studied this variation beyond this value). This decrease 
is also expected to have a dependence on 9 (in the limit 
9 = 1, C{t) is independent of t). We have not, however, 
attempted to study in detail the dependence of C(t) with 
t as 9 is varied. 

We have also calculated C{k) when t is kept fixed which 
again shows a behaviour similar to the BA model for large 
values of k, i.e., for non-zero values of 9, C{k) becomes 
a constant. This constant is a function of 9 and we find 
that C(fc) ~ 9"^ for large k gives a good fit to the data. 



of outgoing links. This can be achieved by simply al- 
lowing each existing node the possibility to get attached 
to the incoming node according to the probability given 
in equation (1). However, it is known that making m 
random in this way does not change the BA universality 
class. This happens because even though m is random, 
{m(t)), the mean value is practically independent of time. 
Thus it is possible to replace mo by ('Ti(i)) in the rate 
equation for k{ti,t) and get the same results as in 
the BA model. Such a replacement is meaningful as long 
as the fluctuations are negligible which is true in the un- 
restricted BA case. This we have checked by numerical 
simulations also. 

To get a stochastic model in which {m{t)) is a function 
of time, we let m(t) follow a distribution which depends 
on the number of nodes N{t) present at that time. The 
choice of the distribution can be done in many ways. 
However, we find that in many real networks, where the 
distribution of the out-degree has been done, the dis- 
tribution shows either a power law (e.g. the WWW or 
phone-call network) or an exponential (e.g. as in the ci- 
tation network) tail This study has been done in 
networks evolved for a sufficient duration of time, here 
we assume that the same kind of distribution is valid for 
intermediate times. The dependence on the number of 
nodes present in the system at time t occurs by putting 
the upper bound of m{t) equal to N{t). 

Taking an exponentially decaying distribution of m{t), 
however, again gives nothing new. This is because the 
mean value {m{t)) becomes time independent (within a 
short time) and therefore we get the BA network again. 
Thus we focus our attention on the model in which m{t) 
follows a power law distribution, i.e., Pm{m{t)) oc m{t)^^ 
with 1 < m{t) < N{t). Again we take N{t) — t, i.e., one 
node is being added at a time. 

In this model {m{t)) will have the following behaviour: 

(m(t)) - t (A < 1) (9a) 
~ t^-^ (1< A < 2) (9b) 
~ 0(1) (A > 2). (9c) 



III STOCHASTIC MODELS 

The assumption that an incoming node gets attached 
to a fixed number of nodes at a given time in the deter- 
ministic model is somewhat artificial. In most social net- 
works, the outgoing links also have a distribution which 
usually shows a decay jlS]. Hence one should consider 
randomness in the number of outgoing links in a realis- 
tic manner such that the number of outgoing links m is 
not fixed at time t but is a stochastic variable. In fact, 
m can be a stochastic variable even in the conventional 
BA model by not putting any restriction on the number 



Assuming that m can be replaced by its mean {m{t)), 
the continuum theory discussed in the last section can be 
used for the stochastic model as well once we define an 
effective 9 from the above equations. Thus 9^// = for 
A > 2, 6'e// = 1 for A < 1, and for 1 < A < 2, 9eff = 
2 — A. We should not, however, expect this 'continuum 
mean field theory' to be valid if the fluctuations are not 
negligible. An estimate of the fluctuation in m can also 
be made which shows that it increases as A decreases and 
cannot be neglected for A < 3. 
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FIG. 5: The degree distribution for the stochastic model for 
several values of A (denoted by the labels) are shown. In 

between the BA curve and the curve for A = 2.5, the two 
unlabcllcd curves correspond to A = 4.0 and A — 3.0. For 
higher values of A, the network is grown to 4000 nodes while 
for the lower-most A, we have mgiximum 1000 nodes. 
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FIG. 6: The degree distribution is plotted against k'' to show 
the stretched exponential behaviour for several values of A 
(the labels denote the values of A). The values of b are 0.1, 
0.20, 0.42, 0.3 and 0.2 for A = 2.2, 1.8, 1.5, 1.2, 1.0 respec- 
tively. 



analyse the behaviour of P{k) for A close to 2, e.g. at A = 
2.2 and 2.5, to check the role of fluctuations. For both 
these values, the behaviour of P{k) agrees better with 
a stretched exponential behaviour: P{k) ^ cxp(— afc'') 
albeit with very small values of b (6 ~ 0.10). For 1 < 
A < 2, the deviation from power law is quite clear. As 
A is made smaller than 2, the behaviour of P{k) is no 
longer monotonic and for small values of k it can be fitted 
to a stretched exponential function with b depending on 
A. The range of k over which P{k) follows a stretched 
exponential behaviour shrinks beyond A = 1.5 where it 
shows a sharp drop (see for instance the curves for A = 
1.2 and 1.0 in Fig. 6). 

For values of A < 1, the fluctuations increase rapidly 
and the network takes very long time to be generated 
as it becomes more and more clustered. P{k) shows a 
slow decay for 0.5 < A < 1 over a long range of k and 
drops sharply as k approaches the total number of nodes 
in the network. The distribution becomes flatter as A 
is decreased. Below A = 0.5, a weakly growing region 
emerges. In fact, a peak appears and becomes sharper as 
A is made smaller. The position of the peak, as t is made 
larger, also shifts towards larger k, e.g., for A = 0.3, 
the peak is at ~ 500 for t = 1000 and at A; ~ 1000 
for t = 2000. A systematic study demands a very large 
amount of computer time and we have not attempted it. 
Nor do we try to fit the data to any familiar form because 
of the large amount of fluctuations. 

As in case of the deterministic network, here too one 
can find out the individual distributions Pout and Pin. As 
expected. Pout shows a power law decay with exponent 
A. Pin almost coincides with the total degree distribution 
as the network becomes larger. 

The behaviour of k{ti,t) has also been studied in this 
network. Again we find a deviation from the power law 
behaviour as A becomes less than 3. As A is made smaller, 
k(ti,t) becomes flat as expected. 



We use numerical simulations to find out the validity 
of the 'continuum mean field theory' in the stochastic 
models. Plotting P{k) vs. k (Fig. 5) for several values 
of A, we find that for large values of A it is indeed BA- 
like. As A is decreased it deviates from the power law 
behaviour. It is difficult to locate the exact value of A 
where the change in behaviour occurs, but clearly, the 
scale-free behaviour observed for A > 3 is no longer valid 
for values of A above 2 but less than 3. For 2 < A < 3, 
the fiuctuations ((m^) — (m)^) scale like N{tj'^^^, which 
means that it becomes stronger for large N{t) and for 
A closer to 2. Increasing N{f?) to large values is difficult 
as it takes a long time to generate the network. So we 



The clustering coefficients have been estimated in this 
model as well. C{t) as a function of A shows a increase as 
A is decreased as expected (e.g, for A = 3.0, C{t) = 0.029 
and for A = 1.5, C{t) = 0.679 for t = 1000). As a 
function of t, C{t) shows a decrease with t for X > 2.0. 
However, as A is made smaller, for the values oft < 2000 
at least, C{t) shows an increase with t. We conjecture 
that C{t) becomes independent of t for large t values for 
A < 2.0. Here C{k) shows a logarithmic deacy with k: 
C{k) ^ a — b\og{ck) with the values of a, & depending 
strongly on A and c ~ 1 for all A. Both a and b approach 
zero for very large A. As A is decreased both a and b 
increase indicating a larger value of C{k) together with a 
sharper decay. 
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IV SUMMARY, COMMENTS AND 
DISCUSSIONS 

We have considered both deterministic and stochastic 
models of growing networks with preferential attachment 
in which the number of outgoing links is a function of 
time. In both models we have followed simple rules of 
evolution with a single tunable parameter. The main 
results obtained in the deterministic model are: 

1. A power law decay of the total degree distribution 
P{k) for large k is obtained which is consistent with the 
continuum theory. 

2. A growing region in P{k) for small k is also observed. 
This is due to the behaviour of the out-degree distribu- 
tion which has a power law increase. A peak is obtained 
in P(fc) for any 9 > 0. The peak position kc is found to 
vary as . 

3. The values of the exponents 7 and f3 can be obtained. 
They satisfy the relation f3{'j — 1) = 1 as in a general 
BA model. 

4. k(ti,t) can be estimated. It is not a function of t/ti 
as in the BA model. 

5. The degree distribution P{k) is also found to be 
non-stationary, i.e., dependent on the time upto which 
the network has been evolved. 

The main results of the stochastic model are: 

1. The behaviour of P{k) depends on the value of A. The 
mean field theory predicts a transition at A = 2 above 
which it becomes BA-like. The numerical simulations 
show that for A > 3 the degree distribution is scale-free 
with 7 = 3. 

2. The degree distribution loses its power law decay 
nature at values of A < 3 and assumes a stretched 
exponential form: P{k) oc exp(— az^). However, the 
deviation from the scale-free behaviour is marginal, as 
indicated by the low value of b in the region 2 < A < 3. 
Hence this maybe a correction to the BA scaling and 
therefore it may not be correct to conclude that a phase 
transition has occurred at A = 3. Clearcut inconsistency 
with the mean field theory is observed for smaller values 
of A when the stretched exponential behaviour of P{k) 
becomes more pronounced. For very small values of A, a 
weakly growing region in P{k) emerges. The data, with 
a lot of fluctuations, is difficult to handle in this region. 
However, this region is not of much interest to us as for 
real networks, such small A values seem unrealistic. 

3. The power law decay behaviour of k{ti,t) observed 
for A > 3 also becomes invalid as A is made smaller. 

4. For large values of A, the degree distribution is 
stationary while for small A (presumably for A < 0.5) it 
becomes dependent on the size of the network. 

A straightforward comparison of the above two mod- 
els shows that the stochastic model is closer to real world 
networks. This is concluded from comparison with real 
world data: the out-degree distributions in phone call, 



citation etc. networks show a decay, either power law or 
exponential, while in the deterministic model, we find a 
growing behaviour. Even though we get a power law de- 
cay of P{k) in the deterministic model, the exponent 7 
is always > 3 while in most real networks, it is closer to 
2 and can be even less than 2. The stochastic model on 
the other hand has a out-degree distribution which shows 
a power law decay. It also shows that the scale-free be- 
haviour can vanish even in a growing network with pref- 
erential attachment. In fact the stretched exponential 
behaviour of the degree distribution observed for small 
degrees is reminiscent of the behaviour of the degree dis- 
tribution in citation network [^. The stochastic model 
is also of theoretical interest as it indicates the existence 
of transitions at finite values of A. However, the deter- 
ministic model has its own merits: it is easy to construct 
and a number of results for it can be obtained analyti- 
cally in the continuum limit. The peak obtained in the 
total degree distribution in this model may be compared 
to similar peaks obtained in some real world networks 
e.g., the co-authorship network [l^ or the Indian rail- 
ways network [lij . 

The citation network is perhaps the most appropri- 
ate network which the stochastic model emulates. How- 
ever, the citation network is essentially a directed net- 
work. Therefore we have also considered a specific di- 
rected model in the stochastic case, which follows the 
attachment rule as in |l3| and where Pm(jn) has a peak 
and an exponential decay 0. The results show that it 
has a power law decay in the in-degree distribution with 
7 ~ 2 (not much different from the case when there is no 
accelerated growth |l3|l. There are some available data 
on citation network 'u, 7\ but the data and the analyses 
are not sufficiently general to compare with simulation 
data. In this context it may be mentioned that in a 
model to simulate the gene regulatory network, which is 
a directed network with accelerated growth, the outgoing 
links also show a power law with exponent close to 2 in 
good agreement with theory [lo|. 

In conclusion, we have tried to construct models of 
accelerated growth where the number of outgoing links 
increase with the network size following certain prescrip- 
tions. A continuum theory can be formulated for the 
deterministic case which can be applied in the stochastic 
case in the mean field limit. Based on the different results 
obtained in the models we conclude that the stochastic 
model is closer to real- world networks. 
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